Systems and methods for receiving infrared data with a camera designed to detect images based on visible light

ABSTRACT

Systems and methods for receiving infrared data with a camera designed to detect images based on visible light are provided. A system can include a camera and image processing circuitry electrically coupled to the camera. The image processing circuitry can determine whether each image detected by the camera includes an infrared signal with encoded data. If the image processing circuitry determines that an image includes an infrared signal with encoded data, the circuitry may route at least a portion of the image (e.g., the infrared signal) to circuitry operative to decode the encoded data. If the image processing circuitry determines that an image does not include an infrared signal with encoded data, the circuitry may route the image to a display or storage. Images routed to the display or storage can then be used as individual pictures or frames in a video because those images do not include any effects of infrared light communications.

BACKGROUND OF THE INVENTION

This is directed to infrared data transmission. In particular, this isdirected to systems and methods for receiving infrared data with acamera designed to detect images based on visible light.

Many electronic devices includes cameras designed to detect images. Forexample, a traditional cellular telephone or portable media player mayinclude a camera. Such cameras can typically detect images based onvisible light but do not receive any data communications through eithervisible or invisible light. Accordingly, the functionality of cameras intraditional electronic devices is limited.

SUMMARY OF THE INVENTION

This is directed to systems and methods for receiving infrared data witha camera designed to detect images based on visible light. A system caninclude a camera and image processing circuitry electrically coupled tothe camera. The image processing circuitry can determine whether eachimage detected by the camera includes an infrared signal with encodeddata. If the image processing circuitry determines that an imageincludes an infrared signal with encoded data, the circuitry may routeat least a portion of the image (e.g., the infrared signal) to circuitryoperative to decode the encoded data. If the image processing circuitrydetermines that an image does not include an infrared signal withencoded data, the circuitry may route the image to a display or storage.Images routed to the display or storage can then be used as individualpictures or frames in a video because those images do not include anyeffects of infrared light communications.

Based on the decoded data, a device can display information to a user ormodify an operation of the device. In some embodiments, a device can,based on receive infrared data, display information to a user relatingto an object near the user. For example, an infrared emitter can belocated near an object and generate infrared signals with encoded datathat includes information about that object. An electronic device canthen receive the infrared signals, decode the data and display theinformation about the object to the user. In some embodiments, a devicecan, based on received infrared data, disable a function of the device.For example, an infrared emitter can be located in areas where pictureor video capture is prohibited, and the emitter can generate infraredsignals with encoded data that includes commands to disable therecording functions of devices. An electronic device can then receivethe infrared signals, decode the data and temporarily disable thedevice's recording function based on the command.

BRIEF DESCRIPTION OF THE DRAWINGS

The above and other features of the present invention, its nature andvarious advantages will be more apparent upon consideration of thefollowing detailed description, taken in conjunction with theaccompanying drawings in which:

FIG. 1 is a block diagram of an illustrative electronic device forreceiving infrared data in accordance with one embodiment of theinvention;

FIG. 2 is a schematic view of an illustrative system for communicatinginfrared data in accordance with one embodiment of the invention;

FIG. 3 is a timing diagram of infrared data communications in accordancewith one embodiment of the invention;

FIG. 4 is a perspective view of an illustrative system for communicatinginfrared data in accordance with one embodiment of the invention;

FIG. 5 is a perspective view of an illustrative system for communicatinginfrared data in accordance with one embodiment of the invention;

FIG. 6 is a perspective view of an illustrative screen for configuringan electronic device to receive infrared data in accordance with oneembodiment of the invention;

FIG. 7 is a flowchart of an illustrative process for receiving infrareddata in accordance with one embodiment of the invention;

FIG. 8 is a flowchart of an illustrative process for operating a cameraand image processing circuitry in accordance with one embodiment of theinvention; and

FIG. 9 is a flowchart of an illustrative process for receiving infrareddata in accordance with one embodiment of the invention.

DETAILED DESCRIPTION

This is directed to systems and methods for receiving infrared data witha camera designed to detect images based on visible light. An electronicdevice can receive infrared data with a camera that is designed todetect visible light. For example, an electronic device can include acamera for capturing pictures or videos based on visible light and thatcamera can also be used to receive infrared data. To prevent theinfrared data from interfering with the camera's other functions (e.g.,capturing pictures or videos), the electronic device may analyze thecamera's outputs to determine which images include an infrared signalwith encoded data. Accordingly, images (e.g., single pictures or framesof a video) that include an infrared signal with encoded data can berouted to circuitry that can decode the encoded data (e.g., a processoror dedicated decoding circuitry). The decoded data can then be used toconvey information to a user (e.g., through a display) or modify thedevice's operation (e.g., apply a watermark to a detected image ordisable a function of the device). Images that do not include aninfrared signal with encoded data can be routed to other components of adevice for more traditional image functions. For example, images that donot include an infrared signal can be routed to a display that candisplay the images to a user or storage that can record the images. Itmay be advantageous to only route images that do not include an infraredsignal with encoded data to a display or storage because an infraredsignal with encoded data may affect portions of the image. For example,an infrared signal may overcome visible light detected by the camera sothat at least portions of the image are washed out or blacked out.

FIG. 1 is a schematic view of an illustrative electronic device forreceiving infrared data in accordance with one embodiment of theinvention. Electronic device 100 can include control circuitry 101,storage 102, memory 103, communications circuitry 104, input interface105, display 106, camera 107 and image processing circuitry 108. In someembodiments, one or more of the components of electronic device 100 canbe combined or omitted. For example, storage 102 and memory 103 can becombined into a single mechanism for storing data. In some embodiments,electronic device 100 can include other components not combined orincluded in those shown in FIG. 1, such as a power supply (e.g., abattery or kinetics) or a bus. In some embodiments, electronic device100 can include several instances of the components shown in FIG. 1 but,for the sake of simplicity, only one of each of the components is shownin FIG. 1. For example, device 100 can include multiple cameras atdifferent locations on the device (e.g., a front camera and a backcamera).

Electronic device 100 can include any suitable type of electronic deviceoperative to capture an image (e.g., a picture or a frame of a video).For example, electronic device 100 can include a media player with acamera such as an iPod® available by Apple Inc., of Cupertino, Calif., acellular telephone with a camera, a personal e-mail or messaging devicewith a camera (e.g., a Blackberry® or a Sidekick®), an iPhone® availablefrom Apple Inc., a pocket-sized personal computer with a camera, apersonal digital assistant (PDA) with a camera, a laptop computer with acamera, a cyclocomputer with a camera, a music recorder with a camera, avideo recorder with a camera, a stand-alone camera, and any othersuitable electronic device with an image sensor. In some embodiments,electronic device 100 can perform a single function (e.g., a devicededicated to capturing images) and in other embodiments, electronicdevice 100 can perform multiple functions (e.g., a device that playsmusic, captures images, displays pictures or video, stores pictures orvideo, and receives and transmits telephone calls).

Control circuitry 101 can include any processing circuitry or processoroperative to control the operations and performance of an electronicdevice of the type of electronic device 100. Storage 102 and memory 103,which can be combined can include, for example, one or more storagemediums or memory used in an electronic device of the type of electronicdevice 100. In particular, storage 102 and memory 103 can store imagesas well as data representing received infrared data.

Communications circuitry 104 can include any suitable communicationscircuitry operative to connect to a communications network and totransmit communications (e.g., voice or data) from device 100 to otherdevices within the communications network. Communications circuitry 104can be operative to interface with the communications network using anysuitable communications protocol such as, for example, Wi-Fi (e.g., a802.11 protocol), Bluetooth®, radio frequency systems (e.g., 900 MHz,1.4 GHz, and 5.6 GHz communication systems), cellular networks (e.g.,GSM, AMPS, GPRS, CDMA, EV-DO, EDGE, 3GSM, DECT, IS-136/TDMA, iDen, LTEor any other suitable cellular network or protocol), infrared, TCP/IP(e.g., any of the protocols used in each of the TCP/IP layers), HTTP,BitTorrent, FTP, RTP, RTSP, SSH, Voice over IP (VOIP), any othercommunications protocol, or any combination thereof. In someembodiments, communications circuitry 104 can be operative to providewired communications paths for electronic device 100.

Input interface 105 can include any suitable mechanism or component forreceiving inputs from a user. In some embodiments, input interface 105can include a touch interface for receiving touch inputs from a user.For example, input interface 105 can include a capacitive touch assemblyfor receiving touch inputs from a user. In some embodiments, inputinterface 105 can include a touch interface for receiving touch inputsfrom a user that include multi-touch gestures. Input interface 105 canalso include circuitry operative to convert (and encode/decode, ifnecessary) analog signals and other signals into digital data, forexample in any manner typical of an electronic device of the type ofelectronic device 100.

Display 106 can include any suitable mechanism for displaying visualcontent (e.g., images or indicators representing data). For example,display 106 can include a thin-film transistor liquid crystal display(LCD), an organic liquid crystal display (OLCD), a plasma display, asurface-conduction electron-emitter display (SED), organiclight-emitting diode display (OLED), or any other suitable type ofdisplay. In some embodiments, display 106 can include a backlight forilluminating the display. For example, display 106 can include one ormore incandescent light bulbs, light-emitting diodes (LEDs),electroluminescent panels (ELPs), cold cathode fluorescent lamps (CCFL),hot cathode fluorescent lamps (HCFL), any other suitable light source,or any combination thereof. Display 106 can display visual content inblack-and-white, color, or a combination of the two. Display 106 candisplay visual content at any suitable brightness level or resolution.In some embodiments, the brightness level or resolution of display 106can be adjusted by a user (e.g., through display configuration options).Display 106 can be electrically coupled with control circuitry 101,storage 102, memory 103, any other suitable components within device100, or any combination thereof. Display 106 can display images storedin device 100 (e.g., stored in storage 102 or memory 103) or captured bydevice 100 (e.g., captured by camera 107).

Camera 107 can include any suitable device for detecting images based onvisible light. For example, camera 107 can detect single pictures orvideo frames based on visible light. Camera 107 can also detect infraredsignals with encoded data. For example, camera 107 can detect imagesthat include infrared signals. In some embodiments, camera 107 mayinclude a filter for blocking light of particular wavelengths or rangesof wavelengths. For example, camera 107 can include a filter that blocksinfrared light near the edge of the visible light spectrum (e.g., near700 nm) but not infrared light with a substantially longer wavelengths(e.g., near 850 nm or 950 nm). Camera 107 can include any suitable typeof sensor for detecting visible and infrared light in an environment. Insome embodiments, camera 107 can include a lens and one or more sensorsthat generate electrical signals. The sensors of camera 107 can beprovided on a charge-coupled device (CCD) integrated circuit, forexample.

Image processing circuitry 108 can include circuitry for processing theoutput of a camera. For example, image processing circuitry 108 caninclude circuitry for converting signals from one or more sensors incamera 107 to one or more digital formats. Image processing circuitry108 can be electrically coupled to camera 107. Image processingcircuitry 108 can receive images detected by camera 107, includingimages detected by camera 107 that include infrared signals with encodeddata. In some embodiments, image processing circuitry 108 can determinewhether a detected image includes an infrared signal with encoded data.For example, image processing circuitry 108 can determine whether adetected image includes more than a certain number of pixelsrepresenting infrared light. In some embodiments, image processingcircuitry 108 can include circuitry for pre-processing digital imagesbefore they are transmitted to other circuitry within device 100.

As previously described, an electronic device can receive infrared datawith a camera designed to detect images based on visible light. Inaccordance with the disclosure, any suitable device with an infraredemitter can generate infrared signals with data encoded therein. Forexample, a transmitter with an infrared emitter can generate infraredsignals with encoded data. The combination of a device generatinginfrared signals with encoded data and a device that can receiveinfrared signals with a camera designed to detect images based onvisible light can form a communications system.

FIG. 2 is a schematic view of system 200 for communicating infrared datain accordance with one embodiment of the invention. System 200 caninclude transmitter 290 and electronic device 210. Transmitter 290 cangenerate infrared signal 299 with encoded data and electronic device 210can detect one or more images that include infrared signal 299.Electronic device 210 can then decode the data in infrared signal 299and provide information to a user and/or modify its operation based onthe decoded data.

Transmitter 290 can include any device for generating infrared signals.In some embodiments, transmitter 290 can be a dedicated device forgenerating infrared signals with encoded data. In other embodiments,transmitter 290 can be integrated into a device that performs otherfunctions (e.g., a light, a security camera or an access card reader) inaddition to generating infrared signals with encoded data. Transmitter290 can include any components suitable for generating infrared signals.For example, transmitter 290 can include infrared emitter 297electrically coupled with control circuitry 291.

Infrared emitter 297 can include any component that can transmitinfrared signals based on a control signal. For example, infraredemitter 297 can include an infrared light-emitting diode (LED). In someembodiments, infrared emitter 297 may emit a strobe of infrared lightthat cameras in the same general area of transmitter 290 can detect,regardless of the direction the cameras are facing. For example,transmitter 290 can function as a beacon generating an infrared signalthat is easy for cameras to detect. In other embodiments, infraredemitter 297 may emit a directed beam of infrared light that only camerasin the path of the beam can detect. For example, transmitter 290 canfunction as a “spot light” generating an infrared signal that can onlybe received by cameras generally in front of transmitter 290.

Infrared emitter 297 can receive control signals from control circuitry291 and generate infrared signals based on the control signals. Controlcircuitry 291 can include any timing circuitry, processing circuitry,processor or other suitable circuitry operative to control the infraredsignals generated by emitter 297. In addition to infrared emitter 297and control circuitry 291, transmitter 290 can include any othersuitable components for generating infrared signals with encoded data.For example, transmitter 290 can include a power source, such as abattery (not shown), to power infrared emitter 297 and control circuitry291.

Infrared signal 299 can include data encoded in any suitable manner. Forexample, infrared signal 299 can include data encoded based on amplitudemodulation, frequency modulation, phase modulation or a combinationthereof. In another example, infrared signal 299 can include dataencoded based on selectively activating different light sources (e.g.,activating different combinations of infrared emitters). Data encoded ininfrared signal 299 can correspond to any suitable information orcommands. In some embodiments, infrared signal 299 can include encodeddata that represents information about an object adjacent to transmitter290. For example, transmitter 290 can be located adjacent to a museumexhibit and infrared signal 299 can include encoded data that representsinformation about the exhibit. In some embodiments, infrared signal 299can include encoded data that represents a command. For example,transmitter 290 can be located in an area where photography isprohibited and infrared signal 299 can include encoded data thatrepresents a command to disable recording functions.

Electronic device 210 can be substantially similar to electronic device100 shown in FIG. 1 and the previous description of the latter can beapplied to the former. For example, electronic device 210 can includecontrol circuitry 211, storage 212, display 216 and image processingcircuitry 218 that are substantially similar to, respectively, tocontrol circuitry 101, storage 102, display 106 and image processingcircuitry 108 of device 100. Electronic device 210 can also includeother suitable components for an electronic device (see, e.g., storage102, memory 103, communications circuitry 104, and input interface 105,each of which is shown in FIG. 1).

Electronic device 210 can include a filter for blocking portions of theelectromagnetic spectrum from camera 217. For example, electronic device210 can include filter 227 disposed adjacent to camera 217. Filter 227can block light of particular wavelengths or ranges of wavelengths fromcamera 217. In some embodiments, filter 227 can block infrared lightnear the edge of the visible light spectrum (e.g., near 700 nm) but notinfrared light with substantially longer wavelengths (e.g., near 850 nmor 950 nm).

An electronic device can receive infrared data from a transmitter byselectively routing images, or portions thereof, to circuitry within thedevice. For example, images that include infrared data can be routed tocontrol circuitry for decoding (see, e.g., control circuitry 101 shownin FIG. 1) and images that do not include infrared data can be routed toa display or storage (see, e.g., display 106 and storage 102, each ofwhich is shown in FIG. 1). Accordingly, electronic device 210 canreceive infrared data from transmitter 290 by selectively routingimages, or portions thereof, using image processing circuitry 218. Insome embodiments, image processing circuitry 218 can route images, orportions thereof, based on whether or not the images include infraredsignals with encoded data.

Image processing circuitry 218 can use any suitable technique orcombination of techniques for determining if a detected image includesan infrared signal with encoded data. For example, image processingcircuitry 218 may determine the number of pixels in a detected imagethat represent infrared light and compare that number to a threshold. Inanother example, image processing circuitry 218 may determine if adetected image includes pixels that represent a spatial pattern ofinfrared light. In yet another example, image processing circuitry 218may determine if a sequence of detected images includes pixels thatrepresent a temporal pattern of infrared light.

If an image includes an infrared signal with encoded data, imageprocessing circuitry 218 can route at least a portion of the signal tocontrol circuitry 211. For example, image processing circuitry 218 canroute the infrared signal to control circuitry 211 for decoding the datain the signal. Control circuitry 211 can then perform a function basedon the decoded data. For example, control circuitry 211 may instructdisplay 216 to display information to a user based on the decoded data.In another example, control circuitry 211 may disable a device function(e.g., a recording function) based on the decoded data.

On the other hand, if an image does not include any infrared signalswith encoded data, image processing circuitry 108 can route the image todisplay 216 for displaying the image and/or storage 212 for storing theimage. For example, if image processing circuitry 218 determines anabsence of infrared signals with encoded data in an image, it may routethe image to display 216 for displaying the image. In another example,if image processing circuitry 218 determines an absence of infraredsignals with encoded data in an image, it may route the image to storage212 for later retrieval. In some embodiments, only images that do notinclude infrared signals with encoded data may be routed to a display.This may be advantageous because it may avoid displaying images that arevisibly affected by infrared signals (e.g., images that include a washedout portion or a blacked out portion from an infrared signal).

In some embodiments, an electronic device may detect consecutive images(e.g., video frames) based on the timing of an infrared signal withencoded data. For example, an infrared signal may include activesegments of infrared transmission with gaps in between the segments andan electronic device may detect images at a sampling rate that is twicethat of the active segments. Accordingly, the electronic device mayalternate between detecting images with an infrared signal for decodingand images without an infrared signal for displaying and/or storing.FIG. 3 includes timing diagram 300 of infrared communications inaccordance with one embodiment of the invention. Diagram 300 showssignal segments 310 (e.g., segments 311-317) and image detection points320 (e.g., detection points 321-325 and detection point 329).

As previously explained, an infrared signal with encoded data caninclude multiple signal segments 310 that are distributed over time withgaps in between the signal segments. Each of signal segments 310 (seee.g., segments 311-317) can include a portion of an infrared signal. Aninfrared signal with encoded data can be divided into signal segmentsusing any suitable technique. In some embodiments, a signal segment caninclude infrared light at an amplitude, frequency or phase that ismodulated to represent data. For example, segment 312 may be a burst ofinfrared light at a first frequency and segment 323 may be a burst ofinfrared light at a second frequency. In some embodiments, theamplitude, frequency or phase of a signal segment can represent a binarybit that is either high or low. For example, segment 312 may be a burstof relatively high-frequency infrared light (e.g., a high bit) andsegment 313 may be a burst of relatively low-frequency infrared light(e.g., a low bit).

Based on the timing of signal segments, an electronic device can detectimages at a suitable frequency. For example, image detection points 320can be timed based on the frequency at which signal segments 310 areprovided. In some embodiments, image detection points 320 can occur at afrequency that is twice the frequency at which signal segments 310 areprovided. For example, image detection points 320 can include a pointcorresponding to each signal segment (e.g., point 323 corresponding tosegment 312) as well as a point corresponding to each gap between thesignal segments (e.g., point 324 corresponding to the gap betweensegments 312 and 313). Accordingly, images detected by an electronicdevice may alternate between images that include an infrared signal withencoded data (e.g., images suitable for decoding) and images that do notinclude any infrared signals with encoded data (e.g., images suitablefor display and/or storage). In some embodiments, image detection points320 can occur at a frequency that is four, eight or sixteen times thefrequency at which signal segments 310 are provided. For example, imagedetection points can include one or more points corresponding to eachsignal segment as well as any number of points corresponding to each gapbetween the signal segments. In some embodiments, the rate of imagedetection points (e.g., points 320) may be limited by the frame rate ofa camera in a device (see, e.g., camera 107 shown in FIG. 1 and camera217 shown in FIG. 2) or image processing circuitry in a device (see,e.g., image processing circuitry 108 shown in FIG. 1 and imageprocessing circuitry 218 shown in FIG. 2). For example, the rate ofimage detection points may not exceed the frame rate of a device'scamera or image processing circuitry. In such embodiments, infraredtransmitters (e.g., transmitter 290 shown in FIG. 2) may be configuredso that the rate at which infrared signal segments are provided (e.g.,the rate at which segments 310 are provided) does not exceed half theframe rate of a device's camera or image processing circuitry.

In some embodiments, infrared data can be received and an electronicdevice can present information to a user based on the infrared data. Forexample, a transmitter can be located adjacent to an object and anelectronic device can receive infrared data that includes informationabout the object. FIG. 4 is a perspective view of an illustrative systemfor communicating infrared data in accordance with one embodiment of theinvention. System 400 can include transmitter 490 and electronic device410. Transmitter 490 can generate infrared signals 499 with encodeddata, and electronic device 410 can receive infrared signals 499, decodethe data in infrared signals 499 and display information based on thedecoded data.

Transmitter 490 may be substantially similar to transmitter 290 shown inFIG. 2 and the previous description of the latter can be applied to theformer. For example, transmitter 490 can include an infrared emitter forgenerating infrared signals based on control signals (see, e.g.,infrared emitter 297 shown in FIG. 2) and control circuitry forcontrolling the infrared emitter (see, e.g., control circuitry 291 shownin FIG. 2). In some embodiments, transmitter 490 may emit a directedbeam of infrared light (e.g., by manipulating the infrared light withone or more lenses) so that only cameras in the beam can detect theinfrared light. For example, transmitter 490 can function as a “spotlight” generating an infrared signal that can only be received bycameras located generally in front of transmitter 490. This directedbeam approach may be advantageous in situations where multipletransmitters are located in the same room because it may prevent acamera from receiving infrared signals from multiple transmitters. Forexample, if a museum includes multiple exhibits in a room with atransmitter for each exhibit, it may be advantageous to employtransmitters that generate directed beams of infrared light so that thecameras do not receive infrared signals from multiple transmitters. Onthe other hand, if a museum includes a single exhibit in a room, it maybe advantageous to employ one or more transmitters that generate strobesof infrared light so that all cameras in the room can receive theinfrared signals. As previously discussed, a transmitter can encode datain an infrared signal using any suitable technique. For example,transmitter 490 can encode data in infrared signal 499 using amplitudemodulation, frequency modulation, phase modulation or any combinationthereof.

Transmitter 490 can be located adjacent to object 480. For example,object 480 can be an exhibit at a museum and transmitter 490 can belocated adjacent to the object. In some embodiments, transmitter 490 caninclude visible indicia that also convey information about object 480.For example, transmitter 490 can be in the form of a plaque with writingthat conveys information about object 480.

Device 410 can be an electronic device with a camera. Device 410 can besubstantially similar to device 100 shown in FIG. 1 and device 210 shownin FIG. 2 and the previous descriptions of the latter can be applied tothe former. For example, device 410 can include a camera (not shown) forcapturing images based on visible light as well as images that includean infrared signal with encoded data (see, e.g., camera 107 shown inFIG. 1 and camera 217 shown in FIG. 2). Device 410 can include display416 (see, e.g., display 106 shown in FIG. 1) and any other suitableelectronic device components (see, e.g., control circuitry 101, storage102, memory 103, communications circuitry 104, input interface 105, andimage processing circuitry 108).

Display 416 can display information 422 based on infrared data receivedby device 410. For example, transmitter 490 may generate infraredsignals 499 with encoded data that represents information about object480. Continuing the example, electronic device 410 can receive infraredsignals 499 using a camera (see, e.g., camera 107 shown in FIG. 1 andcamera 217 shown in FIG. 2) and decode the data in the infrared signals.Display 416 can then display information 422 to a user based on thedecoded data.

In some embodiments, display 416 can provide one or more images detectedby device 410 in combination with information received by device 410.For example, information 422 can be overlaid on a picture captured bydevice 410 or a live video stream captured by device 410. As seen inFIG. 4, display 416 can provide at least one image detected by device410 that includes representation 421 of object 480. Information 422 canbe provided adjacent to representation 421 so that a user can associatethe information with object 480. The image provided by display 416 canalso include representation 429 of transmitter 490. As previouslydiscussed, an electronic device can control the timing (e.g., rate) ofimage detection based on an infrared signal. For example, infraredsignal 499 may include multiple segments with gaps between the segments(see, e.g., signal segments 310 shown in FIG. 3), and device 410 maycapture one or more images that include representations 421 and 429during gaps between infrared signal segments (see, e.g., detectionpoints 322 and 324 shown in FIG. 3). Accordingly, display 416 candisplay an image that does not include any affects from infrared signal499. For example, the area around representation 429 of transmitter 490may be free from any washed out or blacked out affects of infraredlight. In embodiments where display 416 is providing a video feedcaptured by device 410, display 416 may alternate between updating thedetected image and decoding infrared signals so that the detected imageappears live even though every second image may include an infraredsignal with encoded data and be blocked from display 416 (e.g., routedto control circuitry for decoding the infrared signal).

In some embodiments, information based on infrared data may be providedin different locations of a display based on where the transmitter islocated relative to the device. For example, if a transmitter is locatedabove and to the left of a device, information based on infrared datareceived from the transmitter may be provided in a top-left corner ofthe device's display. In some embodiments, information may be providedat a location of the device's display that overlaps a representation ofthe transmitter. Providing information in this localized manner may beadvantageous in situations where there are multiple objects in adetected image because localized display of information can direct auser's attention to the corresponding object. For example, if there aremultiple pieces of art on a single wall and a transmitter adjacent toone of the pieces that generates infrared signals with encoded dataabout that piece, information based on the infrared signals can beprovided adjacent to or overlapping the representation of thetransmitter (e.g., representation 429 of transmitter 490) so that a usercan easily associate the information with the corresponding piece ofart.

In some embodiments, display 416 can provide options for a user toobtain additional information or content about object 480. For example,display 416 can include audio option 423 that a user can select torequest a prerecorded audio segment and video option 424 that a user canselect to request a prerecorded video segment. In some embodiments, adevice may stream or download additional information or content about anobject in response to a user requesting additional information. Forexample, a device may receive additional information or content throughinfrared signals 499 in response to a user requesting additionalinformation. In another example, a device may download additionalinformation or content through another communication protocol inresponse to a user requesting additional information. In such anexample, the device may obtain a reference number from infrared signal499 and then use that reference number to request additional informationor content through a wireless communication protocol (e.g., an 802.11protocol). However obtained, a device can then provide additionalinformation or content to a user. For example, a device can play back aprerecorded audio segment about object 480 in response to a userselecting option 423 or play back a prerecorded video segment aboutobject 480 in response to a user selecting option 424. In someembodiments, a device may simply provide additional information that isalready stored on the device (e.g., in storage or memory) in response toa user requesting additional information. For example, a device mayobtain a reference number from infrared signal 499 and then use thatreference number to retrieve additional information or content stored onthe device.

While the previous discussion makes references to an infraredcommunications system for communicating information about exhibits in amuseum, it is understood that infrared communications systems inaccordance with the disclosure can be used to communicate informationabout any type of object. For example, infrared communications systemscan be used to communication information about objects for sale in aretail environment (e.g., manufacturer, designer, price and discountstatus).

In some embodiments, infrared data can be received and an electronicdevice can modify a device operation based on the infrared data. Forexample, an electronic device can disable a function of the device basedon received infrared data. In some embodiments, a transmitter can belocated in areas where capturing pictures and videos is prohibited(e.g., a concert or a classified facility) and the transmitters cangenerate infrared signals with encoded data that includes commandstemporarily disabling recording functions. Accordingly, devices near thetransmitter may be able to detect images to receive the infrared signalsand the commands encoded in the signal but those devices may be unableto capture pictures or videos because of the commands. FIG. 5 is aperspective view of an illustrative system for communicating infrareddata in accordance with one embodiment of the invention. System 500 caninclude transmitters 590 and electronic device 510. Transmitters 590 cangenerate infrared signals 599 with encoded data, and electronic device510 can receive infrared signals 599, decode the data in infraredsignals 599 and modify a device operation based on the decoded data. Forexample, device 510 can disable a function of the device based on thedecoded data.

Transmitters 590 may each be substantially similar to transmitter 290shown in FIG. 2 and the previous description of the latter can beapplied to the former. For example, each of transmitters 590 can includean infrared emitter for generating infrared signals based on controlsignals (see, e.g., infrared emitter 297 shown in FIG. 2) and controlcircuitry for controlling the infrared emitter (see, e.g., controlcircuitry 291 shown in FIG. 2). In some embodiments, transmitters 590may emit a strobe of infrared light that cameras in the same generalarea of transmitters 590 can detect, regardless of the direction thecameras are facing. For example, transmitters 590 can function as abeacon generating infrared signals 599 that are easy for cameras todetect. As previously discussed, transmitters can encode data in aninfrared signal using any suitable technique. For example, transmitters590 can encode data in infrared signal 599 using amplitude modulation,frequency modulation, phase modulation or any combination thereof.

In some embodiments, transmitters 590 may be synchronized so thattransmitters 590 can generate infrared signals 599 in a synchronizedmanner. For example, transmitters 590 may be electrically or wirelesslycoupled together to synchronize infrared signals 599. In anotherexample, transmitters 590 can be under the direction of a singleinstance of control circuitry (see, e.g., control circuitry 291 shown inFIG. 2) that is shared between the devices.

In the embodiment shown in FIG. 5, transmitters 590 can be locatedadjacent to stage 580. Accordingly, when a device near stage 580 orpointed at stage 580 receives an infrared signal from transmitters 590,the device's may be unable to capture pictures of videos because of acommand encoded in the infrared signal.

Device 510 can be an electronic device with a camera. Device 510 can besubstantially similar to device 100 shown in FIG. 1 and device 210 shownin FIG. 2 and the previous descriptions of the latter can be applied tothe former. For example, device 510 can include a camera (not shown) forcapturing images based on visible light as well as images that includean infrared signal with encoded data (see, e.g., camera 107 shown inFIG. 1 and camera 217 shown in FIG. 2). Device 510 can include display516 (see, e.g., display 106 shown in FIG. 1) and any other suitableelectronic device components (see, e.g., control circuitry 101, storage102, memory 103, communications circuitry 104, input interface 105, andimage processing circuitry 108).

As previously discussed, the ability of device 510 to capture picturesor videos may be disabled based on a command encoded in an infraredsignal. Accordingly, device 510 may be unable to display or store imagesif the device has received a command to disable recording. In someembodiments, display 516 may provide indicator 521 to a user to conveythat it has received a command to disable recording. For example, if auser selects a record function while that function is temporarilydisabled, display 516 may provide a black screen with indicator 521 tonotify the user that recording has been disabled.

In some embodiments, a device may apply a watermark to detected imagesas an alternative to completely disabling a recording function. Forexample, a device may receive infrared signals with encoded data thatincludes a command to apply a watermark to detected images. In such anexample, the device may then apply the watermark to all detected imagesthat are displayed or stored (e.g., single pictures or frames of avideo).

In some embodiments, a user can configure a system to receive infrareddata. A user may be able to configure several aspects of receivinginfrared data or performing functions based on received infrared data.For example, a user may be able to specify the sensitivity of imageprocessing circuitry when receiving infrared data. In another example, auser may be able to specify what information is displayed in response toreceiving infrared data. FIG. 6 is a perspective view of an illustrativescreen for configuring an electronic device to receive infrared data inaccordance with one embodiment of the invention. Device 600 can be anelectronic device with a camera. Device 600 can be substantially similarto device 100 shown in FIG. 1 and device 210 shown in FIG. 2 and theprevious descriptions of the latter can be applied to the former. Forexample, device 600 can include a camera (not shown) for capturingimages based on visible light as well as images that include an infraredsignal with encoded data (see, e.g., camera 107 shown in FIG. 1 andcamera 217 shown in FIG. 2). Device 600 can include display 606 (see,e.g., display 106 shown in FIG. 1) and any other suitable electronicdevice components (see, e.g., control circuitry 101, storage 102, memory103, communications circuitry 104, input interface 105, and imageprocessing circuitry 108).

Electronic device 600 can display a configuration screen on display 606as part of the device's configuration options. A configuration screencan include options for controlling how infrared data is received. Insome embodiments, display 606 may provide option 621 corresponding toreceiving infrared data generally. For example, a user may set option621 to “OFF” so that device 600 cannot receive any infrared data. In theembodiment shown in FIG. 6, option 621 may be set to “ON” so that thedevice can receive infrared data (e.g., the device can detect imagesthat include infrared signals with encoded data). In some embodiments,display 606 may provide option 622 corresponding to infraredsensitivity. For example, a user may set option 622 on a sliding scalebetween “LOW” and “HIGH” to specify the sensitivity of device 600 toinfrared signals. More specifically, the value of option 622 may specifythe sensitivity of image processing circuitry in device 600 (see, e.g.,image processing circuitry 108 shown in FIG. 1 and image processingcircuitry 218 shown in FIG. 2). If option 622 is set to a “LOW”sensitivity, device 600 may only determine that a detected imageincludes an infrared signal with encoded data if the image includes arelatively large number of pixels representing infrared light. On theother hand, if option 622 is set to a “HIGH” sensitivity, device 600 maydetermine that a detected image includes an infrared signal with encodeddata if the image includes only a modest number of pixels representinginfrared light. As previously discussed, an image processing circuitryin a device can use any suitable technique or combination of techniquesfor determining if a detected image includes an infrared signal withencoded data. Accordingly, sensitivity option 622 can specify one ormore suitable aspects of the technique or combination of techniques usedto determine if a detect image includes an infrared signal with encodeddata.

A configuration screen can include options corresponding to one or morefunctions performed based on received infrared data. In someembodiments, display 606 may provide option 623 corresponding to alertswhen receiving infrared data. For example, a user may set option 623 to“OFF” so that device 600 will not provide any alerts when receivinginfrared data. In the embodiment shown in FIG. 6, option 623 may be setto “ON” so that device 600 provides an alert when receiving infrareddata. For example, device 600 may provide an audio alert (e.g., achime), a visual alert (e.g., an icon), a tactile alert (e.g., avibration), or any combination thereof in response to receiving infrareddata.

In some embodiments, display 606 may provide option 624 corresponding tothe display of information received via infrared data. For example, auser may set option 624 to “OFF” so that device 600 will not displayinformation received through infrared data. In the embodiment shown inFIG. 6, option 624 may be set to “ON” so that device 600 displaysinformation received through infrared data. For example, if device 600detects an infrared signal with encoded data, display 606 may displayinformation in the data (see, e.g., device 410 displaying information422, both of which are shown in FIG. 4).

In some embodiments, display 606 may provide option 625 corresponding tothe storage of information received via infrared data. For example, auser may set option 625 to “OFF” so that device 600 will not storageinformation received through infrared data. In the embodiment shown inFIG. 6, option 625 may be set to “ON” so that device 600 storesinformation received through infrared data. For example, if device 600detects an infrared signal with encoded data, device 600 may store thedata for later access.

It is understood that, in embodiments where an infrared data includescommands to temporarily disable a device function, a user may not beable to set configuration options that override the disable commands.Allowing a user to set options in such a manner may defeat the purposeof providing disable commands through infrared data by allowing a userto perform the function meant to be disabled.

As previously described, a device can include a camera for detectingimages and image processing circuitry that selectively routes eachdetected image based on whether the image includes an infrared signalwith encoded data. Detected images that include an infrared signal withencoded data can then be routed to circuitry for decoding the data. FIG.7 is a flowchart of illustrative process 700 for receiving infrared datain accordance with one embodiment of the invention. Process 700 can beperformed by an electronic device with a camera (e.g., device 100 shownin FIG. 1 or device 210 shown in FIG. 2). Process 700 can begin withblock 710.

At block 710, a camera can be used to detect an image based on at leastvisible light. For example, a camera in an electronic device can detectan image that includes at least a visible light component. Some imagesdetected by a camera at block 710 may include an infrared lightcomponent. For example, some images detect by a camera at block 710 mayinclude infrared signal with encoded data. Any suitable camera can beused to detect an image at block 710 (see, e.g., camera 107 shown inFIG. 1 and camera 217 shown in FIG. 2).

At block 720, whether the image includes an infrared signal with encodeddata can be determined. As previously described, any suitable techniquecan be used to determine whether the image includes an infrared signalwith encoded data. For example, a device can determine whether more thana certain number of pixels represent infrared light to determine whetherthe image includes an infrared signal with encoded data. Moreover, anysuitable type of image processing circuitry can be used to determinewhether the image includes an infrared signal (see, e.g., imageprocessing circuitry 108 shown in FIG. 1 and image processing circuitry218 shown in FIG. 2). Block 720 can serve as a decision node in process700. For example, if an image includes an infrared signal with encodeddata, process 700 can proceed with block 730.

At block 730, at least a portion of the image can be routed to circuitryoperative to decode the encoded data in the infrared signal. In someembodiments, only the infrared signal in the image can be routed tocircuitry operative to decode the encoded data. In other embodiments,the entire image can be routed to circuitry operative to decode theencoded data. Any suitable type of image processing circuitry can routeat least a portion of the image at block 730 (see, e.g., imageprocessing circuitry 108 shown in FIG. 1 and image processing circuitry218 shown in FIG. 2). Moreover, at least a portion of the image can berouted to any suitable circuitry operative to decode the encoded data.In some embodiments, at least a portion of the image can be routed tocontrol circuitry operative to decode the encoded data (see, e.g.,control circuitry 101 shown in FIG. 1 and control circuitry 211 shown inFIG. 2).

In some embodiments, process 700 can also include decoding the encodeddata and modifying a device operation based at least on the decodeddata. For example, process 700 can include applying a watermark to adetected image. In another example, process 700 can include disabling adevice function (e.g., a record function) based on the captured image.

Returning to block 720, if an image does not include an infrared signalwith encoded data, process 700 can proceed with block 740. At block 740,the image can be routed to a display operative to display the image. Anysuitable type of image processing circuitry can route the image at block740 (see, e.g., image processing circuitry 108 shown in FIG. 1 and imageprocessing circuitry 218 shown in FIG. 2).

As previously described, an electronic device can route only detectedimages that do not include an infrared signal with encoded data to adisplay. For example, a system can operate a camera and image processingcircuitry to prevent images including infrared signals with encoded datafrom being displayed or stored. FIG. 8 is a flowchart of illustrativeprocess 800 for operating a camera and image processing circuitry inaccordance with one embodiment of the invention. Process 800 can beperformed by an electronic device with a camera (e.g., device 100 shownin FIG. 1 or device 210 shown in FIG. 2). Process 800 can begin withblock 810.

At block 810, a camera can be used to detect an image based on at leastvisible light. Block 810 may be substantially similar to block 710 ofprocess 700 and the previous description of the latter can be applied toformer.

At block 820, image processing circuitry can determine an absence of aninfrared signal with encoded data in the image. For example, anysuitable image processing circuitry (see, e.g., image processingcircuitry 108 shown in FIG. 1 and image processing circuitry 218 shownin FIG. 2) can determine if an image lacks infrared signals with encodeddata. Identifying the absence of infrared signals with encoded data maybe advantageous because such infrared signal may affect the suitabilityof the image as a picture or video frame.

At block 830, the image ca be routed to a display operative to displaythe image. Block 830 may be substantially similar to block 740 ofprocess 700 and the previous description of the latter can be applied tothe former. In some embodiments, process 800 can also include displayingthe image on the display. In some embodiments, process 800 can alsoinclude displaying the image on the display as a frame of a capturedvideo.

As previously described, an electronic device can receive infraredsignal with encoded data and then disable a device function based on thedecoded data. FIG. 9 is a flowchart of illustrative process 900 forreceiving infrared data in accordance with one embodiment of theinvention. Process 900 can be performed by an electronic device with acamera (e.g., device 100 shown in FIG. 1 or device 210 shown in FIG. 2).Process 900 can begin with block 910.

At block 910, a camera can be used to capture a first image based onvisible light. For example, a camera in an electronic device can detectan image that includes visible light. In some embodiments, a first imagedetected at block 910 may only include visible light. For example, afirst image detected at block 910 may be completely free of infraredsignals with encoded data. In some embodiments, block 910 may occur at adetection point when no infrared signal is being generated (see, e.g.,detection points 322 and 324, both of which are shown in FIG. 3). Anysuitable camera can be used to detect an image at block 910 (see, e.g.,camera 107 shown in FIG. 1 and camera 217 shown in FIG. 2).

At block 920, the first image can be displayed. For example, a devicecan display the first image as a single picture or a frame in a video.Any suitable display can be used to display an image at block 920 (see,e.g., display 106 shown in FIG. 1 and display 216 shown in FIG. 2).

At block 930, the camera can be used to capture a second image thatincludes an infrared signal with encoded data. For example, the cameracan be used to capture a second image that includes one or more pixelsrepresenting infrared light that is modulated in a way to communicatedata. In some embodiments, block 930 may occur at a detection point whenan infrared signal is being generated (see, e.g., detection points 321,323 and 325, each of which is shown in FIG. 3). Like block 910, anysuitable camera can be used to detect an image at block 930 (see, e.g.,camera 107 shown in FIG. 1 and camera 217 shown in FIG. 2).

At block 940, whether the encoded data includes a disable command can bedetermined. For example, the encoded data can be decoded to determinewhether the data includes a disable command. Determining whether theencoded data includes a disable command can be determined by anysuitable circuitry (see, e.g., control circuitry 101 shown in FIG. 1 andcontrol circuitry 211 shown in FIG. 2). In response to determining thatthe encoded data includes a disable command, process 900 can proceed toblock 950.

At block 950, a record function can be disabled. For example, if theencoded data includes a disable command, the device can temporarilydisable its record function for a period of time after receiving thecommand (e.g., 30 seconds or 30 minutes). After the device's recordfunction is disabled, the device may not be able to store imagesdetected by the device. In some embodiments, after the device's recordfunction is disabled, the device may not be able to even display imagesdetected by the device (see, e.g., system 500 shown in FIG. 5). In someembodiments, a device may even delete one or more of the most recentlystored images (e.g., the first image detected at block 910) whendisabling the device's record function.

The various embodiments of the invention may be implemented by software,but can also be implemented in hardware or a combination of hardware andsoftware. The invention can also be embodied as computer readable codeon a computer readable medium. The computer readable medium can be anydata storage device that can store data which can thereafter be read bya computer system. Examples of a computer readable medium includeread-only memory, random-access memory, CD-ROMs, DVDs, magnetic tape,and optical data storage devices. The computer readable medium can alsobe distributed over network-coupled computer systems so that thecomputer readable code is stored and executed in a distributed fashion.

The above described embodiments of the invention are presented forpurposes of illustration and not of limitation.

1.-25. (canceled)
 26. A method comprising: capturing an image;determining whether the captured image comprises infrared data; inresponse to a determination that the captured image comprises infrareddata, decoding the infrared data; and in response to a determinationthat the captured image does not comprise infrared data, retaining thecaptured image for use by a user.
 27. The method of claim 26, furthercomprising, in response to a determination that the captured imagecomprises infrared data, operating an electronic device based on thedecoded infrared data.
 28. The method of claim 27, wherein the operatingcomprises applying a watermark to at least a portion of the capturedimage.
 29. The method of claim 27, wherein the operating comprisesdisabling a function of the electronic device.
 30. The method of claim29, wherein the function comprises a record function.
 31. The method ofclaim 30, wherein the capturing is done by the electronic device. 32.The method of claim 26, further comprising, in response to adetermination that the captured image comprises infrared data,displaying information based on the decoded infrared data.
 33. A methodcomprising: receiving an infrared signal that comprises a first activesegment and a second active segment consecutive with the first activesegment; determining an amount of time between receipt of the firstactive segment of the received infrared signal and receipt of the secondactive segment of the received infrared signal; and capturing aplurality of images based on the determined amount of time.
 34. Themethod of claim 33, wherein each image of the plurality of capturedimages comprises both visible light and infrared light.
 35. The methodof claim 33, wherein the determined amount of time is at least twice anamount of time between the capture of a first captured image of theplurality of captured images and the capture of a second captured imageof the plurality of captured images consecutive with the first capturedimage.
 36. The method of claim 33, wherein the captured plurality ofimages comprises frames of a video.
 37. A system comprising: a cameraconfigured to capture an image comprising visible light; a componentconfigured to determine whether the captured image comprises infrareddata; a decoder configured to decode the infrared data in response tothe component determining that the captured image comprises infrareddata; and storage configured to store the captured image in response tothe component determining that the captured image does not compriseinfrared data.
 38. A method comprising: capturing an image comprisingvisible light data and infrared light data; decoding the infrared lightdata of the captured image; and disabling a record function of anelectronic device based on the decoded infrared light data.
 39. Themethod of claim 38, wherein the capturing comprises capturing the imagewith the electronic device.